Performance of Three MODIS Fire Products (MCD45A1, MCD64A1, MCD14ML), and ESA Fire_CCI in a Mountainous Area of Northwest Yunnan, China, Characterized by Frequent Small Fires

An increasing number of end-users looking for ground data about fire activity in regions where accurate official datasets are not available adopt a free-of-charge global burned area (BA) and active fire (AF) products for applications at the local scale. One of the pressing requirements from the user community is an improved ability to detect small fires (less than 50 ha), whose impact on terrestrial environments is empirically known but poorly quantified, and is often excluded from global earth system models. The newest generation of BA algorithms combines the capabilities of both the BA and AF detection approaches, resulting in a general improvement of detection compared to their predecessors. Accuracy assessments of these products have been done in several ecosystems; but more complex ones, such as regions that are characterized by frequent small fires and steep terrain has never been assessed. This study contributes to the understanding of the performance of global BA and AF products with a first assessment of four selected datasets: MODIS-based MCD45A1; MCD64A1; MCD14ML; and, ESA’s Fire_CCI in a mountainous region of northwest Yunnan; P.R. China. Due to the medium to coarse resolution of the tested products and the reduced sizes of fires (often smaller than 50 ha) we used a polygon intersection assessment method where the number and locations of fire events extracted from each dataset were compared against a reference dataset that was compiled using Landsat scenes. The results for the two sample years (2006 and 2009) show that the older, non-hybrid products MCD45A1 and, MCD14ML were the best performers with Sørensen index (F1 score) reaching 0.42 and 0.26 in 2006, and 0.24 and 0.24 in 2009, respectively, while producer’s accuracies (PA) were 30% and 43% in 2006, and 16% and 47% in 2009, respectively. All of the four tested products obtained higher probabilities of detection when smaller fires were excluded from the assessment, with PAs for fires bigger than 50 ha being equal to 53% and 61% in 2006, 41% and 66% in 2009 for MCD45A1 and MCD14ML, respectively. Due to the technical limitations of the satellites’ sensors, a relatively low performance of the four products was expected. Surprisingly, the new hybrid algorithms produced worse results than the former two. Fires smaller than 50 ha were poorly detected by the products except for the only AF product. These findings are significant for the future design of improved algorithms aiming for increased detection of small fires in a greater diversity of ecosystems.